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Abstract — In this paper, the second-order statistics of the 
instantaneous mutual information are studied, in time-varying 
Rayleigh fading channels, assuming general non-isotropic scatter- 
ing environments. Specifically, first the autocorrelation function, 
correlation coefficient, level crossing rate, and the average outage 
duration of the instantaneous mutual information are investigated 
in single-input single-output (SISO) systems. Closed-form exact 
expressions are derived, as well as accurate approximations in 
low- and high-SNR regimes. Then, the results are extended 
to multiple-input single-output and single-input multiple-output 
systems, as well as multiple-input multiple-output systems with 
orthogonal space-time block code transmission. Monte Carlo 
simulations are provided to verify the accuracy of the analytical 
results. The results shed more light on the dynamic behavior of 
the instantaneous mutual information in mobile fading channels. 

Index Terms — Rayleigh Fading, Autocorrelation Function, 
Correlation Coefficient, Level Crossing Rate, Average Outage 
Duration, Mutual Information, Multiple Antennas. 



I. Introduction 

THE increasing demand for wireless communication over 
time-varying channels has motivated further investigation 
of the channel dynamics and its statistical behavior. There are 
numerous studies on the temporal second-order characteristics 
of a variety of terrestrial [l]-[4] and satellite channels [5], 
such as the correlation function, level crossing rate (LCR), 
and average fade duration. 

For such important quantity as the instantaneous mutual 
information (IMI), however, only the mean value, which is the 
ergodic capacity, has received much attention as well as the 
outage probability [6] [7]. Clearly, ergodic capacity and outage 
probability do not show the dynamic temporal behavior of 
IMI in time-varying fading channels. For example, the outage 
probability of a fading channel gives the probability of IMI to 
be smaller than a particular data rate [6]. Nevertheless, it does 
not show how long, on average, IMI stays below that rate. 
To the best of our knowledge, only some simulation results 
regarding such second-order statistics are given in [8], without 
analytical results, and in [9], lower and upper bounds on the 
correlation coefficient in the high signal-to-noise ratio (SNR) 
regime, as well as some approximations, are derived without 
exact results. 
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In this paper, several second-order statistics of IMI are 
studied in time-varying Rayleigh flat fading channels, con- 
sidering a general non-isotropic scattering propagation en- 
vironment. Closed-form expressions and simple approxima- 
tions are derived for the autocorrelation function (ACF), 
correlation coefficient, LCR and the average outage duration 
(AOD) of IMI. A variety of channels are considered such 
as multiple-input single-output (MISO), single-input multiple- 
output (SIMO), multiple-input multiple-output with orthogonal 
space-time block code (OSTBC) transmission, and MIMO in 
the low-SNR regime. Monte Carlo simulations are provided 
to verify the accuracy of our closed-form expressions and 
approximate results. 

Notation: t is reserved for matrix Hermitian, * for complex 
conjugate, tr[-] for the trace of a square matrix, j for \/—\, 
E[-] for mathematical expectation, !,„ for the m x m identity 
matrix, In(-) for the natural logarithm, log2(-) for the base-2 
logarithm, 0( ) for the order, || • \\f for the Frobenius norm, 
/^(x) for [/(x)]^, and maxa<x<b f {x) for the maximum of 
f{x) over the range a < x < b. 

The rest of this paper is organized as follows. Sec. II 
introduces the IMI random process in a single-input single- 
output (SISO) system, whereas the channel and angle-of- 
arrival (AoA) models are described in Appendix I. Sec. Ill is 
devoted to the derivation of ACF and the correlation coefficient 
of IMI in SISO channels, as well as their low- and high- 
SNR approximations. The LCR and AOD of SISO IMI are 
derived in Sec. IV. Extension of the SISO results systems with 
multiple antennas are discussed in Sec. V. Numerical results 
are presented in Sec. VI, and concluding remarks are given in 
Sec. VII. 

II. The SISO IMI 

Similar to [6], we consider a piecewise constant approxima- 
tion for the continuous-time SISO fading channel coefficient 
h{t), represented by {h{lTs)}f^^, where % is the symbol 
duration and L is the number of samples. In the presence 
of additive white Gaussian noise, if perfect channel state 
information {^(^Zs)}^i is available at the receiver only, the 
ergodic channel capacity is given by [6] [7] 



C = E [log2 (1 + rjaf)] 



(1) 



bps/Hz, where rj is the average SNR at the receiver side, ai 
is the envelop of h{lTs), i.e., ai = \h{lTs)\,yi. We choose 
E[q!^] = 1, i.e., the channel has unit power. 

In the above equation, at any given time index I, log2(l + 
7]af) is a random variable as it depends on the fading 



2 



parameter ai [6]. Therefore 

Ii = log2 (1 + T]af) 



(2) 



is a discrete-time random process with the ergodic capacity as 
its mean. We study the second-order statistics of such 
as autocorrelation, correlation coefficient, LCR and AOD, in 
the following sections. 

III. ACF AND Correlation Coefficient 

OF THE SISO IMI 

In this section, first we concentrate on the ACF of IMI, 
define in (2). The ACF is defined by 



ri(i)=E[X,X,_,], 



: (log2 efE[lnil+r]Xi)ln{l+r]X2)] , 



(3) 
(4) 



where Xi = af, X2 = oif-i^ and xi and X2 have a joint Chi- 
square probability density function (PDF) with 2 degrees of 
freedom [6, (3.2)] [10, pp. 163, (8-103)] 

pixi,X2) = A,e-^'("i+"^'/o(2A,ft , (5) 

where A.; = = \ph{iTs)\ < I, i ^ 0, phir) = 

E[h{t)h'*{t — t)] is the correlation coefficient of the Rayleigh 
fading channel, and hiz) = i e^™"^ cos(fe6')d6' is the fc* 
order modified Bessel function of the first kind. A closed-form 
expression for /5/i(t) in non-isotropic scattering environments 
is given in the Appendix I. 

Combining (4) and (5), with the following Taylor series [11, 
pp. 971, 8.447.1] 



t 



2k 



(6) 



simplifies (4) to the following exact infinite-summation closed- 
form representation 

n 2 
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0,0,fc+l 



dx 



(7) 



where G is Meijer's G function [11, pp. 1096, 9.301] and the 
normalized ACF is given by 
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(8) 



After some algebraic manipulations, we obtain the correla- 
tion coefficient as 



1 



rx(^)-{E[X,]P 
E[X2]_{E[X;]}2' 

OO 



E 

k=Q 



34/ A 



fc! "-^2,31 



0,1 

0,0,A:+1 



2e-G 



3,0/ 1 



1,1 

0,0,0 



(9) 



(10) 



where r(a,z) = f'-^e'^dt [11, pp. 949, 8.350.2] is the 
upper incomplete gamma function. The derivation of (7), (8) 
and (10) are given in Appendix 11. 

In general, it seems difficult to further simplify (8) and 
(10). However, we note that the integral E{k,rj,\i) ~ 
x'=e-^'^ ln(l + rix)dx, fc > 0, can be approximated by 



S(fc,77, Aj) 



' rOO 

Jo 



k+l. 



77^0, 



(11) 



using ln(l + rjx) w r/x, 77 — > 0, and ln(l + j]x) In (ryx), 
7] ^ 00, respectively'. 

In the following two subsections, we will use (7) and (11) 
to derive asymptotic closed-form expressions for rx{i) in the 
low- and high-SNR regimes. 

A. Low-SNR Regime 

If 7] 0, based on (7) and (11), we have 

_ X S|(fc,77, A,) 



^A.E 



(log2e)2 ^Z^^(X,g,)-2k^k\)^' 



(12) 



where ^L{k,ri, A;) is defined as 
by [11, pp. 364, 3.381.4] 

(fc + 1)! 



°°x''~^^e ^'"^da; and given 



Si(fc,77, Ai) rj- 



A: 



k+2 



(13) 



By replacing 'E.L{k,ri, Xi) in (12) with (13), we obtain 

2 



k=0 
„2 



(fc + 1)! 

^k+2 



(14) 



A» fc=l 



Since Qi < 1, we have 



E^ 

k=l 



2 „2k 



d 



k=l 



A?ft'(l + e?), (15) 



which simplifies (14) to 



(16) 



After normaUzation by E[X;2] = rx{0) ~ 2(log2 6)2772, we 



obtain 



Moreover, the correlation coefficient is given by 



rj(»)-{(log26)E[77a;]}2 _ 772(l + g2)_^2 

E[X2]-{(l0g26)EM}2- 



2j^2 



(17) 



-Qt, (18) 



where we use E[a::] 



1, due to the unit-power 



Rayleigh fading assumption. 

With isotropic scattering, we have /5/i(t) = Jo(27r/„iT), the 
Clarke's correlation [1], where /,„ is the maximum Doppler 
frequency, and Jo(.i;) = ;^ /q e'^'^°^^d9 is the zero-order 
Bessel function of the first kind. This simplifies (18) to 

J§{2TTfrnlT,) with T = iT,. 

' The utility and accuracy of (11) is confirmed by Monte Carlo simulations 
in Sec. VI. 
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B. High-SNR Regime 

If rj oo, based on (7) and (11), we get 



(logs e)2 



k=0 



(19) 



where ^j^(fc, 77, Ai) is defined as J^x''{ln7] + \nx)e ^'^dx. 
Using 4.352.2 [11, pp. 604] and (13), we obtain 



(20) 



where 7 = 1.781072 • • • is the Euler-Mascheroni constant [11, 
pp. xxx], Hk is the fc* harmonic number [12, pp. 29, (2.13)], 
defined by Hk = J^'^^i } for fc > 1, and Hq = 0. After 
lengthy algebraic calculations, finally the normalized ACF in 
the high-SNR regime is shown to be 



Li.(gf)+ln^^ 

6 7 



(21) 



where Li2 (x) is the dilogarithm function, defined as Li2 (x) 
Sfc^i f^-, I a: I < 1. The correlation coefficient is given by 



6Li2(e?) 



Derivation of (21) and (22) are given in Appendix III. With 
isotropic scattering, (22) reduces to 



6U2[J§i2nfraiTs] 



(23) 



IV. LCR AND AOD OF SISO IMI 

A. The LCR of SISO IMI 

Similar to the calculation of zero crossing rate in discrete 
time [13, Ch. 4], we define the binary sequence {Xi}f'^^, based 
on the IMI sequence as 

1, if Ii > Xth, 



0, if Ii < Xth, 



(24) 



where T± is a fixed threshold. The number of crossings of 
with Xth, within the time interval Ts < t < LTg, 
denoted by -Di^, is defined in terms of {Xi}f^^ [13, (4.1)] 

L 

(25) 



1=2 



which includes both up- and down-crossings. 

After some simple manipulations, the expected crossing rate 
at the level Xth can be written as 



E[D2 



2Pr{Xi = 1} - 2Pr{Xi = l,X;_i = 1} 



(26) 

Therefore the expected down crossing rate at the level Xth, 
denoted by A'i(Xth), is given by 

iVrir,.)^ ^-'^--"-^f'-'-^"-" . (27) 



To simplify the notation, we use cf) for Pr{Xi ~ 1} and (p{gi) 
to denote P,,{X, = l,X,_i = 1}, where gi = \phiTs)\, 
defined before. They can be calculated as follows 



Pr a > 



e ^da; = e 



(28) 



OO 



1 



2^,1, _ 1 



V 



fe=0 



(fc 



1^2 



- ^g1 



k=0 



dx 
2^"- - 1 

fciH^' + ^'^^Iw!) 



(29) 



By plugging (28) and (29) into (27), we obtain the expected 
crossing rate at the level Xth as 



iVi(Xth 



E 

k=0 



■1 



Arfk+i ^ 



(30) 



(22) B. The AOD of SISO IMI 



Based on the relationship between X; and of in (2), the 
cumulative distribution function (CDF) of X; is obtained as 



fx(X,h) ^Pr{o?i< 



1 



1] 



1 - e 



2^111 - 1 



(31) 



The AOD of IMI, normalized by %, is therefore given by^ 

ii(Xth) _ ^i(Xth) 



T,iVi(Xth) ' 



(32) 



V. Extension to Multiple Antenna Systems 

For TV -receiver (Rx) SIMO, M-transmitter (Tx) MISO, 
and M-Tx iV-Rx OSTBC-based MIMO systems, we assume 
perfectly estimated, independent and identically distributed 
subchannels, with the same temporal correlation coefficient 
Ph{T). Therefore the IMIs can be written as [7][14] [15, pp. 
115, (7.4.43)] 



X 



SIMO 
I 



X, 



MISO 
I 



n-OSTBC 



log2 
l0g2 
log2 



N 



i + ?/Ei'^-(^^«)i' 

r=l 
M 

i + lEi^*(^^^)i 



t=i 

N M 



i + ]gEEK*(^^- 



(33a) 
(33b) 
(33c) 



[1]. 



^The definition of IMI AOD is similar to the average envelope fade duration 
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rx{i) 



2e 1 



-E- 

k=0 



„3,l/ 



0,1 
0,0,fc+Ai7V 



fc!(J\fJV+fe-l)! 



MN-1 
i=0 



(34) 



-J, -J. -J 

o,-j-i,-j-i,-j-i 



Px(0 = 



oo Bi 
(MAf-1)! 

fe=0 



3,11 MA, 



0,1 
0,0, k+MN 



k\{MN+k-l)\ 



G 



3,1 / M 



2,3 



0,1 
0, 0, MN 



2(AfiV-l)!ef (m) 



MN 



MN-l 
J=0 



o,-i-i,-j-i,-r 



G 



2,3 1 ^ 



3,1 / M 



0,1 

0, 0, MN 



(35) 



where is the expected SNR at each Rx antenna. Note that 
the SIMO and MISO systems in (33a) and (33b) are known as 
maximal ratio combiner (MRC) and maximal ratio transmitter 
(MRT), respectively [16]. 

It is easy to see (33c) includes (33a) and (33b) as special 
cases, by setting M ~ 1 and = 1, respectively. Therefore, 
we only need to consider the OSTBC-based MIMO system. 

At any time index /, X)!^i Sf=i l^r,i(^2^)P is a ran- 
dom variable with the 2MN degrees of freedom. We define 

2/1 = Eti TtLi \hrAlTsr and y, = Er=i EtLi 

i)Ts]\'^. The PDF of yi and the joint PDF of yi and y2 are, 

respectively, given by [17, (2.32), (3.14)] 



p(.yi) 
p{vi,y2) 



-yi 



{MN - 1)! 



' Imn -i{'2.\iQi^/yiV2) 



{MN -l)\gf^-^e^^(v^+y^) 



(36) 
(37) 



According to the series representation of the modified 
Bessel function of the first kind [11, pp. 971, 8.445], we can 
rewrite (37) as 



Af^ (2/12/2) 



MN-l 



{MN 



■E 



{KQ^y'{yly2Y 



fc-1)! 
(38) 



A. ACF and Correlation Coefficient 

By substituting (33c), (36) and (37) into (3), (8) and (9), 
after some manipulations, we obtained the normalized ACF 
and the correlation coefficient as shown in (34) and (35), 
respectively, whose derivations are given in Appendix IV-A. 
Note that = m > n, in (34) and (35). 

1) Low-SNR Regime: In Appendix IV-B, the normalized 
ACF and the correlation coefficient are, respectively, expressed 
as 



fx{i) 



MN + gf 
MN+1 



and 



pi{i) ~ 



(39) 



(40) 



As expected, (39) reduces to (17), when M = N = I. 
Interestingly, the correlation coefficient in the OSTBC-MIMO 
system is the same as that in the SISO system. 

2) High-SNR Regime: The normalized ACF is shown to be 



ri{i) 



(MN-1)\ 



i+lnJ-)>C(2,il/iV) 



H, 



MN- 



\Hmn- 



(i4/iv_i+ln^) +C{2,MN) 



(41) 



where C{z,q) - ^^^^ ^-J^ [11, pp. 1101, 9.521.1] and 
i?2(ef) is given in (76). Therefore, the correlation coefficient 
is 



Px(i) 



(l-gj R2{Bi) 
{MN-1)\ 



C{2, MN) 



(42) 



Derivation of (41) and (42) can be found in Appendix IV-C. 
We have checked that for M = TV = 1, (41) and (42) simpUfy 
to (21) and (22), respectively, using i?2(^?|) = S2{g'i) in (63c). 

To obtain some insight, we consider a 2 x 2 OSTBC-MIMO 
system in the high-SNR regime. For M = TV = 2, (73), (75) 
and (76) reduce to 



Ra{gf) = 
rM) = 

R2{bD = 



6 



ll-61n(l-ef) 



(1 



n2\i 



(43a) 
(43b) 



&W{l-Qi) + &U2{gi) 2(3^?f+4^?2-l) 



i^-giY gfa-gl)' 

(ngl + 18gf-9gf + 2) Hi ~ gf) 



gli^ 



(43c) 



To derive (43c) from (76), we need the integral representation 
of Li2{t) as Li2{t) = — M^-z) which can be derived 
from 0.241.4 in [11, pp. 12], by using '"<^~^^ dz 
[11, pp. 586, 4.291.2]. 
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k=0 



Using (43c), (41) and (42) reduce to, respectively, 

. ^ 6 + 221n|^+61n^|^+6Li2(gf) 
''^^'''^ 12 + 7r2 + 221n^+61n2^ 
^ (lief - 18gf + 9gf ~ 2) ln(l - ) + 8gf - 2g| 
(l2 + 7r 

36Li2(gf 

(67r2 - 49) (67r2 - 49)gf 
6(llgf-18gf + 9g.?-2)ln(l-gf) 
(67r2 - 49) g6 



(45) 



2^221n|^+61n2|^)g^ 



and 



pi{i) 



85gf - 48g2 + 12 



(46) 



B. LCR and AOD 

1) The LCR: We set (if = ^f^^ Y.f=i |/ir,t(^r,)|2, which 
has a distribution with 2MN degrees of freedom, with the 
PDF given by (36). In addition, 0f and 0f_T^ has the joint 
PDF given in (37), with i = 1. Similar to the SISO case, 
and i^(gi) are calculated as 

2^'" - 1 ■ 



Pr { P? > 



■q/M 



yMN-l^-y 



rlMN, 



dy 



7,/M 



(47) 



2 ^.h-i (MN - 1)! " (MN - 1)! 

T7/A-/ 



and 



^(gl) = Pr \ > —^.PU > 

{MN - 1)! ^ 1 kl{MN + k-iy. 



MN 




(1 - 9l 



oo 

2 ^1h - 1 
r,/AJ 

MN 



y 



k+MN-l -\iy 



{MN - 



1)\ ^ 



dy 



glT[k + MN, 



fc=0 



kl{MN + k~ 1)! 



(48) 



where the last expression in (48) comes from (38). 

By plugging (47) and (48) into (27), we obtain the expected 
crossing rate of IMI, at the level Xth, for the OSTBC-MIMO 
system as 



r MN, 



,,/M 



MN 



{MN~l)\% {MN-iy.Ts 

J\/(2^'ii-l) 



oo 

fc=0 



gfr k + MN, 



n{i-el) 



kl{MN + k- 1)! 



(49) 



which includes (30) as a special case, when AI = N = 1. 
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Fig. 1. The AoA distributions for two scattering environments and tlie 
corresponding channel coiTelation coefficients. 



2) The AOD: Based on the connection between xp^™*-- 
Id = i:r=iT.t=i\hrAlTs)? in (33c) and using 
(47), the CDF of 2fs™c written as Fr(Xth) = 

2^.h-iA /(^j^ _ ry{a,z) = r(a) - 



i{mn,^ 

T{a,z) = J^f'-^e-^dt [11, pp. 949, 8.350.1] is the lower 
incomplete gamma function. The AOD, normalized by Ts, is 



given in (44), where r^{a,z) ~ [r{a,z)Y 
and N with 1 in (44), we obtain (32). 



By replacing M 



VI. Numerical Results and Discussion 

In this paper, the generic power spectrum in (54) is used to 
simulate the Rayleigh flat fading channel with non-isotropic 
scattering, according to the spectral method [18]. To verify the 
accuracy of the derived formulas, we consider two types of 
scattering environments: isotropic scattering and non-isotropic 
scattering. For the non-isotropic scattering, we assume there 
are three clusters of scatterers around the mobile station (MS), 
and their parameters [P„, «;„, 9n]^ are given by [Pi, ki, 9i] = 
0.45,2,^], [P2,A«2,N = [0.2,20,^], and [Ps^ks^Os] = 
0.35,3, ^^], respectively. In addition, in all the simulation, 
the maximum Doppler frequency fm is set to lOHz, and 3] = 
2qj^ seconds. 

The distributions of angle-of-arrival (AoA) for both sce- 
narios and the corresponding channel correlation coefficients 
Ph{iTs), i > 0, are plotted in Fig. 1, where "Simu." means 
simulation, and "Theo." refers to (53), with = 10 and 

T iTg — 20 fm ' ^ — 0; 1: 2; ■ ■ ■ ■ 

These parameters are defined in Appendix I, and represent fractional 
contribution, azimuthal spread, and the azimuthal location of the clusters in 
the two dimensional plane. 
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Fig. 2. The ACF, correlation coefficient, LCR, and AOD of IMI in a SISO Fig. 4. The ACF, correlation coefficient, LCR, and AOD of IMI in a SISO 
system with isotropic scattering. system with non-isotropic scattering. 



In the following subsections, simulations are performed to 
verify the ACF, correlation coefficient, LCR and AOD of IMI 
in both types of environment at both low- and high-SNR 
regimes. For evaluating the approximation accuracy of ACF 
and the correlation coefficient, we set 7] = —10 dB for low 
SNR, and rj = 30 dB for high SNR. To verify the LCR and 
AOD expressions, rj — 0,5, 10 dB are the SNRs considered. 

A. Isotropic Scattering 

This is the Clarke's model, with uniform AoA. Simulations 
are performed for both SISO and the 2 x 2 OSTBC-MIMO 
systems, with the results shown in Figs. 2 and 3, respectively. 

B. Non-isotropic Scattering 

This is a general case, with an arbitrary AoA distribution. 
Simulations are also carried out for both SISO and the 2x2 



OSTBC-MIMO systems, with the results presented in Figs. 4 
and 5, respectively. 

In Figs. 2-5, The upper left and right figures show the 
normalized approximate ACF and the approximate correlation 
coefficient of the IMI Ti, respectively, in both low- and high- 
SNR regimes; the lower left is the LCR of Ti, and finally, 
the lower right shows the AOD of X/. Moreover, in Figs. 2 
and 4, for ACF, theoretical values in the low- and high-SNR 
regimes are calculated from (17) and (21), respectively. For 
the correlation coefficient, theoretical values come from (18) 
and (23), for low- and high-SNR regimes, respectively. The 
theoretical SISO LCR and AOD are given by (30) and (32), 
respectively. In Figs. 3 and 5, for ACF, theoretical values in the 
low- and high-SNR regimes are computed via (39) and (45), 
respectively. For the correlation coefficient, theoretical values 
come from (40) and (46) for low- and high-SNR regimes, 
respectively. The theoretical MIMO LCR and AOD are given 



Normaiized ACF of llvli 



Correlation Coefficierrt of iMi 



Normalized ACF of IMI 



Correlation Coefficient of llvll 
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Low SNR(Simu.) 
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-HighSNR(Theo.) 




Ti=0 dB 


/ti=6 dB 4=10 dB/ 


















o Simu. 
Theo. 



IJbps/Hz) 




r]=0 dB 


/n=5dB<ii=10dB/ 




V 1 f 






o Simu. 
— Theo. 



Ubps/Hz) 



Fig. 3. The ACF correlation coefficient, LCR, and AOD of IMI in a 2 X 2 
OSTBC-MIMO system with isotropic scattering. 



Fig. 5. The ACF, correlation coefficient, LCR, and AOD of IMI in a 2 X 2 
OSTBC-MIMO system with non-isotropic scattering. 



7 



by (49) and (44), respectively. 

From Figs. 2-5, the following observations can be made. 

• By comparing Figs. 2 and 4 for the SISO system, one 
can see larger peak values for LCR in the isotropic 
scattering case, which means more fluctuations of IMI. 
On the other hand, the AOD of IMI does not appear to be 
very sensitive to the differences among the propagation 
examples considered. The same conclusions apply to the 
2x2 OSTBC-MIMO system, depicted in Figs. 3 and 5. 

• Based on the results shown in Figs. 2-5, for LCR and 
AOD we can conclude that the theoretical expressions 
perfectly match the simulations, in both propagation 
scenarios and for both SISO and 2 x 2 OSTBC-MIMO 
systems. Moreover, the low- and high-SNR approxima- 
tions for ACF and correlation coefficient are accurate in 
both types of systems and environments. 

• Since in Figs. 3 and 5, the low-SNR approximation for 

is very close to the high-SNR approximation, one 
can conclude that px{i) w gf for any SNR in the OSTBC- 
MIMO systems with not-so-small number of antennas. 
This statement is further supported by the results shown 
in Table I, where for different values of MN, the Taylor 
series of pi{i) in (42) is given, as well as maximum 
values maxo<g.<i |(40) — (42) |. From Table I, one can 
see that the larger the total number of antennas, the 
smaller the difference between (40) and (42). Moreover, 
even for MN = 2, i.e., a MIMO system with two Tx and 
one Rx antennas, or one Tx and two Rx antennas, the 
difference is at most 0.075, when using the approximation 

• According to Figs. 2 and 4, there is small gap between the 
SISO low- and high-SNR approximations of pi{i), which 
is 0.16 at most, shown in Table I. For the non-extreme 
SNR such as 10 dB, the non-approximate pxii) in (10) 
can be used to calculate the correlation coefficient. How- 
ever, by evaluating (10) and Monte Carlo simulations, we 
obtain the following simple approximation 

(pi ^ J7<6.5dB, 

Pt(») - < 4 + 6.5dB<77< 16dB, (50) 



and the approximation error is 0.055 at most. 

VII. Conclusion 

In this paper, closed-form expressions for the level crossing 
rate and average outage duration of the instantaneous mu- 
tual information (IMI) in time-varying Rayleigh flat fading 
channels are derived, as well as the autocorrelation function 
and correlation coefficient of IMI, in SISO, MISO, SIMO 
and OSTBC-MIMO systems. The analytical expressions, sup- 
ported by Monte Carlo simulations, provide useful qualitative 
and quantitative information regarding the fluctuations of IMI. 
For example, as the spread of the angle-of-arrival at the 
mobile receiver increases, the crossing rate of IMI increases, 
according to our results, which means faster fluctuation of 
IMI. Furthermore, IMI values become less correlated. Quan- 
tification of the average outage duration of IMI is another 



TABLE I 

Taylor Expansion of (42) and the Maximum Difference between 
(40) AND (42) FOR Different MN's 



MN 


Taylor Series of (42) 


maxo<g.<i 1(40) - (42)| 


1 


OSOSgf + 0.152gf + Oigf) 


0.16 


2 


n 77^ -1- n 1 90^^^ -1- CK 




3 


n RAAn^ -t- 1 0(\n^ 4- 0( n^) 


0.048 


4 


O.SSlgf + O.OSSgf + 0{gf) 


0.035 


5 


0.904^2 +o.075(?f + 0{e^) 


0.027 








16 


0.969e2 +0.0294 + 


0.008 








64 


0.992i)2 +0.008^ + 0(^8) 


0.002 



noteworthy outcome of this work. For example, with isotropic 
scattering, the IMI of a SISO system, with a 10 dB SNR and 

10 Hz Doppler frequency, remains below Xth = 6 bps/Hz for 
almost 7 seconds, on average, i.e., an average outage duration 
of 7 seconds at the data rate 6 bps/Hz. 

In this paper, we have not considered the spatially un- 
correlated general MIMO system with M transmitters and 
N receivers, where all the subchannels are independent and 
identically distributed, with the same temporal correlation 
function. The mutual information in this case is given by [14] 

11 = log2det[lAr + fjJi{m)UHlT,)], where H(;r,) is the 
channel matrix at time t = ITg. However, for low SNRs, it is 
straightforward to show that the MIMO IMI Ii is quite similar 
to the OSTBC-MIMO IMI, which means that flie approximate 
normalized autocorrelation and correlation coefficient in (39) 
and (40) hold for more general MIMO systems as well^. It 
is our ongoing work to derive closed-form expressions for the 
IMI autocorrelation function, correlation coefficient, LCR, and 
AOD of MIMO systems with any SNR, and also some high- 
SNR approximations. 

Appendix I 
Channel and Angle-of-Arrival Models 

In a flat Rayleigh fading channel, the lowpass complex 
envelope of the channel response h{t) is a zero-mean complex 
Gaussian random process, which can be represented as 

h{t) = hi{t)+jhQ{t) = a(i)cxphj$(t)], (51) 

where the zero-mean real Gaussian random processes hi{t) 
and hQ{t) are the real and imaginary parts of h{t), respec- 
tively. a{t) is the envelope of h{t) and is the phase 
of h{t). At any time t, a{t) has a Rayleigh distribution and 
is distributed uniformly over [0, 27r). Without loss of 
generality, we assume the Rayleigh channel has unit power, 
i.e., E[a^it)] = 1. 

To model the distribution of the angle-of-arrival (AoA) 
of waves impinging either the base station (BS) or mobile 
station (MS), we use multiple von Mises distributions. The 

''For the correlation coefficient of MIMO IMI in the low-SNR regime, the 
same result as px{i) ~ is derived in [9]. 
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von Mises PDF has proven to be a flexible AoA model for 
both BS [19] and MS [4]. For example, in the macrocellular 
environment shown in Fig. 6, two von Mises distributions are 
needed to model the two clusters of scatterers around the MS. 
In general, we write the PDF of AoA in the azimuth plane as 
the superposition of K von Mises PDFs 

pW = f: ^6 [0,2.), (52) 

n=l 



2t:Io{k„) 



where 6n is the mean AoA from the n* cluster, k„ controls 
the width of the cluster, and P„ represents the contribution 
of die cluster, such that ^« = 1,0 < P„ < 1. If 

Kn = 0, Vn, (52) simplifies to p{9) = 2^, 6* G [0, 27r), which is 
the Clarke's two-dimensional isotropic scattering model. The 
AoA PDF given in (52) is general enough to model AoA 
distributions observed in practice. Furthermore, it provides 
closed-form and mathematically-tractable expressions for the 
channel correlation functions [4] [19]. 

The channel correlation coefficient ph{T) and the power 
spectrum of Rayleigh fading for the AoA model in (52) are 
given by 



Phir) ^E[h{t)h*{t-T)], 



(53) 



K 



and 

Shif) 



K 



n=l 

X cosh 



^0 {^kI - 47r2/2jT2 + J^TT KnfmT COS 9n 
exp(K„/c0S 9n / fm) 



[^^n - (///»)' Sin 0„] , I / 1 < /„ , (54) 

respectively, in which /„, is the maximum Doppler frequency, 
and cosli(z) = ^(e^ +e^^) is the hyperbolic cosine function. 
Equations (53) and (54) are derived by extending the results 
of [4], according to (52). If k„ = 0,Vn, (53) and (54) 
simplify p^ir) = lQ{j2'KfmT) = Jo(27r/„T) and Sh{f) = 

7=^ J, I/I < fm, respectively, which correspond to the 

Clarke's model. 

Using (54) and the spectral method discussed in [18], the 
discrete-time version of h{t), i.e., h{lTs), is generated and 



Cluster I 





MS 




Cluster II 



Fig. 6. The scattering environment around the MS with two clusters of 
scatterers. 



used in Sec. VI to verify the accuracy of the new closed-form 
expressions derived in this paper 

Appendix II 
Derivation of (7), (8) and (10) 

With (5) and (6) together, (4) can be written as 

rxii) 



(log2 e)2 7o 7o 



ln(l + T]Xi) ln(l + riX2) 



(fc!)2 



fc=0 
2fe r°° 



(kiy 



d.Tida;2, 



X / 4'e-^'^Mn(l + r;a;2)da;2 
Jo 



= A,E- 



(Ajft) 



2k 



k=0 



(fc!) 



1^2 



1 2 



(55) 



The exponential and logarithm functions can be represented 
by Meijer's G function as follows [20, (11)] 



'\iX _ ^1,0 



and 



ln(l + 7;a::) = G'2;2h2^ 



J ' 

1,1 
1,0 



(56) 



(57) 



Using the integral given in [20, (21)], the integral 
E{k,r],Xi) — x'^e^^^^ + rix)dx in (55) can be 
expressed in the following form 



^(fc,77, A,) 



ifXi 



-(fc+l),-fc 
-(fc+i),-(fc+i),oy ' 

0,1 

0,0,fc+ly 



(58) 



where the last "=" comes from z'^G™^'"! z 



t^^nJ'l ) [21, pp. 521, 8.2.2.15], in which (op) = 

ai, 02, ■ ■ ■ , Op and ~ 61, ^2, ■■ ,bq. By substituting (58) 
into (55), we obtain (7). 

To obtain (8) and (10), we need to calculate 



log2 e 



E[ln(l + 77x1)] andE [Jf] = (log2e)2E [ln2(l + r/xi)] ^ With 
p{xi) ~ e^^\ xi > 0, the characteristic function of ln(l + 
rjxi) is given by 



Z— — -\-Xi 





-1 




Jo 


1 












V 





r 

+ 1,- 



(59) 



The first and second moments of ln(l + 77x1) are obtained as 



J dt 



= e-r 0, - , (60) 
t=o V Vj 
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and 



[ln'(l + 7,a;i)] 



1 d^Ciit) 



1,1 
0,0,0 



(61) 



Appendix IV 
Derivation of Some Results in Sec. V 

A. Derivation of (34) and (35) 

Substitution of (33c) and (37) into (3) results in 



respectively. With (60) and (61), we easily obtain (8) and (10). 



Appendix III 
Derivation of (21) and (22) 



(loga e) 



oo poo 



.0 ^K^ + ir^Oinfi 



M 



2/2 



By plugging (20) into (19) we obtain 

rxii) 



E 

fc=0 



{MN- 1)! 



dyidy2, 



kl{MN + k~l)\ 



{MN- 



(log2 e)2 
1 

" a" 



1 Jzi / \ ' 



1)! E 

' fe=0 



kl{AIN + k~ 1)! 



Ai7 



(62) 



where [22] 



^°°yr^^-^e-^-Mn(l + -;^yi)dyi 
ryr^^^-ie-^--ln(l + ^y2) dy^ 



{MN - 1)! ^ [ kl{MN + k-iy. 



k=0 

= Ai, 

oc 
A:=0 



2fc 



Aj In Ai, 



^2(g.?)=E^'? 

fe=0 

= A, [Li2(g2)+ln2 A,] 
Substitution of (63) into (62) yields 



(63a) 



(63b) 



(63c) 



Vi 



yi dyi 



{MN - 



-MN oo g\ 
T)! E' 



G: 



3,1/ A/A, 
2,3l 



0,1 

Q,Q,k+MN 



k=0 



k\{MN + k-l)\ 



(66) 



For calculating the normalized ACF and the correlation 
coefficient, we need the first and second moments of X;, i.e., 
E [In (1 + ^yi)] and E [in^ {^ + ^yi)]- Using the integral 
results given in (58), we have the first moment as 



E 



ln( 1 + ^.1 



oo MN-1 - 



yi 



(logs 



(64) 




0,1 \ 

0,0,AfiV J 




{MN~~1)\ 



(A/7V-l)!^"l^+M^^)'^y^' 



(67) 



After normalization, i.e., frfi) — — tttt 
(log2 e)^ + In^ 'i), (64) reduces to (21) 



I^^lll^ where ri(0) 



7, 

The correlation coefficient is calculated as follows 

1 2 



Px(j) 



rx(z)-{(log2e)EH??^i)]r 
ri(0)-{(log2e)E[ln(7,xi)]} 
Li2(gf)+ln^^-ln^^ 
^ + In^ li - In^ H ' 
6Li2(&?) 



2 ' 



(65) 



The second moment is given in (69), where the third "=" is 
based on the integral identity 4.358.1 in [11, pp. 607]. 



B. Derivation of (39) and (40) 

For calculating the low-SNR approximation for the normal- 
ized ACF and the correlation coefficient, the following lemma 
is necessary. 

Lemma 1: If \t\ < 1 and p is a non-negative integer, then 
the following identity holds. 



where the second line is from the fact that E [ln(?7a;i)] = In 77+ 
/o°° ^T^xi dxi = In ^ using e~^^ \nxi dxi = — ln7 
[11, pp. 602, 4.331.1]. 



^ ik+p)\{k+p) , ^ (P + t)p\ 

^ kl ' (l-t)P+2' 



fe=0 



(68) 



Proof: For p = 0, obviously it holds [1 1, pp. 8, 0.231.2]. 
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In^ ( 1 



71/ 



yi 



= 70 (MiV-1)! l^+M^O^^^' 



iMN-iy.{^) 



MN 



(f)"''r(^'f 



(A/7V-l)!(^ 



.MTV 



A/7V-1 



j=0 ^ 



-3: -J, -j 

o,-j-i,-i-i,-j-i 



(M7V-1)!(^ 



. MN 



(69) 



For p > 1 we have 



/c=0 



fc! 



QP- 



QP 

dtp 



dtP-^ 

k+p 



t- 



k=0 

d tP ] dP 
'dtp 



k=0 
QP 

dtp 



t^yt^+P 



k=0 



dtl-t 



tP{p-pt + t) 



{l~tf 



(1 - t)P+2 ' 



C. Derivation of (41) and (42) 

For the high-SNR regime, the approximation of is 
detailed in (77), where a high-SNR approximation similar to 
(11) in the SISO case is used, and Rj{gf), j ~ 0,1,2, are 
given in (73), (75), and (76), respectively. In what follows, 
we focus on how to calculate the three infinite summations 
Rj{t),j = 0, l,2,|i| < 1, introduced in (77). First, we 
consider i?o(i) 



where the fourth "=" is from X^fcLo ^^^^ ~ i^t ' when \t\ < 1 
and p is an positive integer. ■ 
Using the low-SNR approximation, similar to (11) in the 
SISO case, with x, k, and t] replaced by j/i, k + MN — 1, and 
77/A/, respectively, (66) reduces to 



2 \MN 



(A; ft 



\2k 



(log2 e)2 ~ A-P{MN - 1)! ^ | k\{MN + fc - 1)! 



2 \ MN 



1)! ^ fc! 



2k 



NP{MN - 1)! ^ k\{MN + fc - 1)! 



{k + MN)\ 

yk+MN+l 



VI y 

Af2(A/iV-l)!Af^+2 ^ 

ri^N{MN + Ql) 
M ' 



(fc + A/jV)!(fc + MjV) , 



fc! 



(70) 



where the last "=" is from Lemma I. Therefore we have 
the approximate normalized ACF as given in (39). For the 
approximate correlation coefficient we obtain 



rxW-{(log,e)E[^y]}^ 
n^NjMN+el) ^2 at2 



(71) 



M 



ri^N{MN+l) 
M 



^2^2 



where ¥,[yi] ~ MN [17, pp. 14, (2.35)] is used in the second 
line of (71). 



(k+MN-iy.t'' 



k=0 
qMN-1 



fc! 



k+MN-l 



°° f^MN-1 

2i ^k+MN-l 



k=0 
gMN-1 



Q^MN- 



MN-2 



Q^MN- 



T E^^- E 



dt^^^ 

k=0 \k=0 k=0 / 

QlMN-l f^iMN-l n _i\MN ' ^ ' 



k=0 



Qf-MN- 



il-t) 



where we use So{t) = in (63a). Therefore we have 



i?o(ft?) = E 



(fc + A/7V-l)! 2fc_ (A/7V-1)! 



fe=0 



fc! 



With the same reasoning we obtain 



d^'^~^S,{t) 



,j = 1,2, 



(73) 



(74) 



where Sj{t),j = 1,2, are given by (63b) and (63c), respec 
tively. Hence 



(fc + MN - 1)! 

— J^k+MN-lQi , 



k=0 

qMN-1 



fc! 



ln(l - t) 



t=e\ 



^ (A/iV-l)![gMjV-i-ln(l-g2)] 

(1 - qIY'"" 

2^ v(fc+iU^V-l)! 



(75) 



\+MN-lQi 1 



^A/JV-1 
g^MN^ 



Li2(t)+ln2(l-t) 



(1-0 



(76) 
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riii) 



\ A IN 
\ 




OO 

E 








/•OO 


k+MN 




[MN - 


1)! 


fc!(A/iV + 


k - 


1)! 


-■^ 




\MN 




OO 

E 




\2k 
) 




" />oo 


..k+MN 




{MN - 


1)! 


k\{MN + 


k - 


1)! 


Jo 








OO 

E 

/c=0 


{hQi 








-MN~ 


1)! 


{MN - 


1)! 


k\{MN + 


k- 


1)! 





In- 



-i:+J\/Af-l 



^ {k + MN-mgf}>^ f Ty 



k\ 



{MN -l)\X 



MN 



R2{Qi) + 2R,{ei)\n 



MXa 



MXa 



MXa 



(77) 



The second moment of In {jjll) is given by 
^x(O) ^ 



(log2e)2 



(AfiV-l)! M^^^^^' 



(A/TV -1)170 



H, 



MN 



-1+ln^j +C(2,MAr), (78) 

in which the last "=" is from 4.358.2 [11, pp. 607], where 
in [11] ip{q) = Hq-i — Iwy, with 5 as a positive integer [11, 
pp. 952, 8.365.4]. Therefore, we obtain (41) for the normaHzed 
ACF. With 



E 



{MN-iy. ^^17^^)^^^' 



(79) 



where the last "=" is from (20), we have (42) for the correlation 
coefficient. 
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